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ABSTRACT: In this paper we discuss four problems regarding Markov equivalences 
for subclasses of loopless mixed graphs. We classify these four problems as finding con- 
ditions for internal Markov equivalence, which is Markov equivalence within a subclass, 
for external Markov equivalence, which is Markov equivalence between subclasses, for 
representational Markov equivalence, which is the possibility of a graph from a subclass 
being Markov equivalent to a graph from another subclass, and finding algorithms to 
generate a graph from a certain subclass that is Markov equivalent to a given graph. We 
particularly focus on the class of maximal ancestral graphs and its subclasses, namely 
regression graphs, bidirected graphs, undirected graphs, and directed acyclic graphs, and 

present novel results for representational Markov equivalence and algorithms. 
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maximal ancestral graph, regression chain graph, summary graph, undirected graph. 
1 Introduction 



Introduction and motivation. In graphical Markov models several classes of graphs 
have been used in recent years. A common feature of all these graphs is that their nodes 
correspond to random variables, and they represent conditional independence statements 
of the node set by specific interpretations of missing edges. 
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For the above graphs, in general, two graphs of different types or even two graphs of 
the same type may induce the same independencies. Such graphs are said to be Markov 
equivalent. It is important to explore the similar characteristics of Markov equivalent 
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graphs, and to find the ways of generating graphs of a certain type with the same 
independence structure from a given graph. 

Some questions for Markov equivalences. There are four main questions regarding 
Markov equivalence for different types of graphs: 

1) Internal Markov equivalence: The first natural question that arises in this con- 

text is regarding when two graphs of the same type are Markov equivalent. This 
question may be answered for DAGs, MAGs, or other subclasses of LMGs. 

2) External Markov equivalence: In addition to Markov equivalence for graphs of 

the same type, one can discuss Markov equivalence between two graphs of different 
types. 

3) Representational Markov equivalence: Before checking external Markov equiv- 

alence, however, it is essential to check whether and under what conditions a graph 
of a certain type can be Markov equivalent to a graph of another type. 

4) Algorithms: One can also present some algorithms to generate a graph of a certain 

type that is Markov equivalent to a given graph of a different type. 

In this paper we gather and simplify the existing results in the literature for internal 
and external Markov equivalences, and give novel results for representational Markov 
equivalence and algorithms. 



Some earlier results on Markov equivalence for graphs. Results concerning Markov 
equivalence for different classes of graphs have been obtained independently in the statis- 
tical literature on specifying types of multivariate statistical models, and in the computer 
science literature on deciding on special properties of a given graph or on designing fast 
algorithms for transforming graphs. In the literature on graphical Markov models two of 
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Frydenbergl (jl990l ). Two of the later results 



fl2009l ) respectively provided theoretically neat and 
computationally fast conditions for Marko v equivalence for maximal ancestral graphs. 

Besides these, IPearl fc Wermuth ( 1994) provided condition s for Markov equivalence 
for bidirected graphs and DAGs. Ispirtes fc Richardson ( 1997 ) gave some conditions for 
Markov equivalence for maximal ancestral graphs, in which the polynomial computa- 
tional complexity claim was wrong. 

Efficient algorithms for deciding whether a UG can be oriented into a DAG became 
available in the computer science li teratu re under the name of perfect elimination orien- 
tations; see iTarjan &: Yannakakid (jl984l l. whose algorithm can be run in 0(|\^| + \E\). 
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Another such hnear algorithm can be found in iBlair fc PeytonI (119921 ) . An algorithm for 
generating a Mark ov equivalent DAG from a bidirected graph is the special case of the 
algorithm given in IZhao et al\ (120041 ) . 



Structure of the paper. In the next section we define the unifying class of LMGs, 
and provide some basic graph theoretical definitions needed for our results. 

In Section 3 we present the subclasses of LMGs, and we formally define the sub- 
classes of interest in this paper. We also define a so-called separation criterion, called 
m-separation, to provide an interpretation of independencies for the graphs. 

In Section 4 we formally define Markov equivalence, define maximality and explain its 
importance for Markov equivalences, and motivate why we consider Markov equivalence 
for the class of MAGs. 

In Section 5 we gather the conditions existing in the literature for internal Markov 
equivalence for the class of MAGs and its subclasses, and give conditions for their external 
Markov equivalence. 

In Section 6 we discuss the conditions for representational Markov equivalence for 
MAGs and its subclasses to a specific subclass, and we also provide algorithms to generate 
a Markov equivalent graph of a specific type to a given graph of another type when the 
conditions for representational Markov equivalence are satisfied. In each subsection we 
deal with different subclasses of MAGs: DAGs in Section 6.1, UGs and BGs in Section 
6.2, and RCGs in Section 6.3. 

In Section 7 we summarise the results, presented in the paper. 

2 Loopless mixed graphs 

Graphs. A graph G is a triple consisting of a node set or vertex set V ^ an edge set 
E, and a relation that with each edge associates two nodes (not necessarily distinct), 
called its endpoints. A loop is an edge with the same endpoints. When nodes i and j 
are the endpoints of an edge, these are adjacent and we write ^ ~ j. We say the edge is 
between its two endpoints. We usually refer to a graph as an ordered pair G = iV,E). 
Graphs Gi = iyi,Ei) and G2 = {V2,E2) are called equal if {Vi,Ei) = (1/2,-^2)- In this 
case we write Gi = G2- 

Notice that the graphs that we use in this paper (and in general in the context of 
graphical models) are so-called labeled graphs, i.e. every node is considered a different 
object. Hence, for example, graph i j k is not equal to j i k. 



Definition of loopless mixed graph. ISadeghi &: LauritzenI (120111 ) gathered most graphs 



in the literature of graphical models under the definition of loopless mixed graph, which is 
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a graph that contains three types of edges denoted by arrows, arcs (two-headed arrows), 
and hnes (full lines) and does not contain any loops. 



Basic definitions for LMGs. We say that i is a neighbour of j if these are endpoints 
of a line, and z is a parent of j if there is an arrow from i to j. We also define that i is 
a spouse of j if these are endpoints of an arc. We use the notations ne(j), pa(j), and 
sp(j) for the set of all neighbours, parents, and spouses of j respectively. In the cases of 
i — yj or i < > j we say that there is an arrowhead pointing to (at) j 

A subgraph of a graph Gi is graph G2 such that ^(6*2) ^ ^{Gi) and E{G2) C E{Gi) 
and the assignment of endpoints to edges in G2 is the same as in Gi. An induced 
subgraph by nodes A C \/ is a subgraph that contains all and only nodes in A and all 
edges between two nodes in A. A subgraph induced by edges A<Z E \s a. subgraph that 
contains all and only edges in A and all nodes that are endpoints of edges in A. We 
denote the subgraphs induced by arrows, arcs, and lines in a graph H hy H[^], H[^n^], 
and H[ — ] respectively. 

A walk is a hst (fo, ei, wi, . . . , e^, v^) of nodes and edges such that for 1 < i < fc, the 
edge Ci has endpoints Vi-i and Vi. A path is a walk with no repeated node or edge. We 
denote a path by an ordered sequence of node sets. We say a path is between the first 
and the last nodes of the list in G. We call the first and the last nodes endpoints of the 
path and all other nodes inner nodes. 

A cycle in a graph G is a simple subgraph whose nodes can be placed around a circle 
so that two nodes are adjacent if these appear consecutively along the circle. 

A path (or cycle) is direction preserving if all its edges are arrows pointing to one 
direction. If a direction-preserving path is from a node j to a node i then j is an ancestor 
of i. We denote the set of ancestors of i by an(i). 

A graph is called directed if it only contains arrows. A directed graph is acyclic if it 
has no direction-preserving cycle. 

A chord is an edge between two non-adjacent nodes on the cycle. A cycle is chordless 
if it has no chords. The notation C„ is used for a chordless cycle with n nodes. Notice 
that Cn can contain different types of edges, so it represents a class of graphs rather than 
a single graph. We call a graph chordal if it has no C„, n > 4, as an induced subgraph. 
We also use the notation P„ for a chordless or minimal path with n nodes, i.e. a path 
that has no edge between two non- adjacent nodes on the path. 

A V- configuration is a path with th r ee no des and two edges. Notice that originally 
and in most texts, e.g. in iKiiveri et al\ (119841 ). the endpoints of a V-configuration is by 
definition not adjacent. In this paper we call such V-configurations unshielded. 

In a mixed graph the inner node of three V-configurations i — )^tA — j, i < > t^ — j, 
and i < > t < > j is a collider and the inner node of all other V-configurations is a 
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non-collider node on the V-configuration or more generally on a path of which the V- 
configuration is a subpath. We also call the V-configuration with collider or non-collider 
inner node a collider or non- collider V-configuration respectively. We may speak of a 
collider or non-collider node without mentioning the V-configuration or the path when 
this is apparent from the context. In the case of DAGs the only collider V-configuration 
i — >-t^ — j is called a collision V-configuration. 



3 Subclasses of loopless mixed graphs and their independence interpretation 



Subclasses of LMGs The following diagram, presented in lSadeghi fc Lauritzeru (120111 ) 
illustrates the hierarchy regarding inclusions of subclasses of LMGs. 

Loopless mixed graphs 



Ribbonless graphs (modified MC graphs) 



Summary graphs 



(Maximal) ancestral graphs 



Regression chain graphs 




Acyclic directed mixed graphs 



Undirected graphs 



Directed acyclic graphs Bidirected graphs 

Figure 1: The hierarchy of subclasses of LMGs. 



The common feature of all these subclasses is that these use the same interpretation 
for independencies, known as the m-separation criterion. We will shortly introduce the 
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m-separation criterion for MAGs and its subc 
Ribbonless qray hs, defi n ed an d studied in 
graphs, defined by iKosterl (|2002[ ). to discard the line loops and to use the m-separation 
criterion. 



Sadeghil (120111 ) is a modification of MC 



Definition of ancestral graphs and regression chain graphs. An ancestral graph is a 
mixed graph that, for all nodes i, has (1) i ^ an(pa(i) U sp(i)) and (2) If ne(?) ^ then 
pa(i) U sp(i) = 0. This means that there is no arrowhead pointing to a line and there is 
no direction-preserving cycle, and there is no arc with one endpoint the ancestor of the 
other endpoint, in the graph. 
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A graph G = (V, E) is a regression chain graph if it contains at most the three types 
of edge, there is no arrowhead pointing to a hne in graph, and it does not contain any 
arc-direction-preserving cycle, i.e. a cycle that contains arcs and at least one arrow and 
whose arrows are all towards one direction. Thus in such graphs the subgraph induced 
by lines is so-called at the beginning of graph, and the subgraph induced by the arrows 
and arcs is characterised by having a node set that can be partitioned into numbered 
subsets forming so-called chains, i.e. V = tiU ■ ■ - Utt such that all edges between nodes 
in the same subset are arcs and all edges between different subsets are arrows pointing 
from the set with the higher number to the one with the lower number. One can observe 
that in the subgraph induced by the arrows and arcs if we replace every by a node, 
we get a DAG. 



The TO-separation criterion Since, as we shall see, we are only interested in the sub- 
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Let C be a subset of the node set of a MAG. A path is m-connecting given C if 
all its collider nodes are in C U an(C) and all its non-colhder nodes are outside C. For 
two other disjoint subsets of the node set A and B, we say A±mB \ C if there is no 
m-connecting path between A and B given C. 

Notice that the m-separation criterion gives an interpretation of independencies on 
graphs, i.e. it induces an independence model. 



4 Basic concepts for Markov equivalence 

Definition of Markov equivalence. Now we can formally define Markov equivalence. 
Two graphs Gi = {V,Ei) and G2 = (¥,£2) are Markov equivalent if, for all subsets A, 
B, and G oiV , A L mB\C in Gi if and only if A ± ^5 | C in G2. 



Maximality and Markov equivalence. A loopless mixed graph G is called maximal if 
by adding any edge to G the independence model induced by the m-separation criterion 
changes. Alternatively, a graph G = (V, E) is maximal if and only if, for every pair of 
noi i-adiacent nodes i and 7 of V , there exists a subset C * of V \ {i,j} such that i -Lmj \C', 



see 



Richardson fc SpirtesI (120021 ): 



Sadeghi fc LauritzenI (j201l[ ). 



This implies that two Markov equivalent maximal graphs must have the same skeleton, 
where the skeleton of a graph results by replacing each edge by a full line. 
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Motivations behind using MAGs and its subclasses. In this paper we aim to discuss 
Markov equivalence for the subclasses presented in Fig. [1] The cond itions fo r inter nal 
Markov equivalence for RGs and SGs are very complex. However, in ISadeghil (120111 ) it 
was demonstrated how RGs can be mapped into a Markov equivalent SG, and how SGs 
can be mapped into a Markov equivalent AG. Notice that ADMGs are SGs without full 
lines, so by the same method one can map ADMGs into Markov equivalent AGs. 

In addition, since Markov equivalent maximal graphs must have the same skeleton, 
conditions for Mar kov equivalence for MAGs a. re simpler than those for Markov equiv- 
alence for AGs. In iRichardson &: Spirted (120021 ) it was shown how AGs can be mapped 



into a Markov equivalent MAG. Therefore, we map all types of stable independence 
graphs into MAGs and discuss the Markov equivalences for MAGs and its subclasses. 

Notice that all subclasses of MAGs discussed here are maximal by nature. Therefore, 
for their Markov equivalence they must have the same skeleton. 

5 Internal and external Markov equivalences 

5.1 Internal Markov equivalence for maximal ancestral graphs 



'hus far, t 



(lAh et al 



lere are two elegant res ults regarding Markov equivalence for MAGs available 
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Zhao et a/.l . l2004l ). These results use different definitions (colliders with 



order and minimal collider paths) and arguments. Even though it is not immediately 
obvious from their formulations, it can be shown that these are equivalent. 

First result for Markov equ ivalence for MA Gs. In order to present the first theorem, 
we quote two definitions from lAli et al\ ( 120051 ). A path vr = (j, gi, q2, . . . , qm, ^ i), with j 
not adjacent to i, is a discriminating path for {qm, I, i) in G if and only if, for every node 
1 < n < m on vr, i.e. excluding j, and /, 

i) qn is a collider on vr; and 

ii) qn — 7~i, hence forming a non-collider along the path (j, gi, . . . , i). 
Fig. [2] illustrates what a discriminating path looks like. 




Figure 2: A discriminating path. 



Let Vn be the set of triples of order n defined recursively as follows: 



Order 0: A triple (/i, /, i) &I)q ii h and i are not adjacent in G. 
Order n + 1: A triple {h, I, i) G P„+i if 

1) (/i, /, i) ^ Vp, for some p < n + 1 and 

2) there exists a discriminating path vr = {j,qi, . . . ,qm = h, I, i) for / in G, and each 

of the coUiders on the path: (j, gi, gs, ), • • • , (^m-i, g™, ^ Up<n "^p- 

If (/i, /, i) G then the triple is said to have order n. A discriminating path is said to 
have order n if every triple on the path has order at most n and at least one triple has 
order n. If a triple has order n for some n we then say that the triple has order, likewise 
for discriminating paths. 



Theorem 1. lAli & Richardson . \2004) MAGs Hi and H2 are Markov equivalent if and 
only if Hi and H2 have the same skeleton and colliders with order. 

In Fig. [3] there are three MAGs with the same skeleton. In Hi and H2 since i ^ k, 
the collider (i, j, k) is with order 0, whereas in H^ this is not a collider. In Hi and H2, 
the collider (j, /c, h) is with order 1. Therefore, we conclude that Hi and H2 are Markov 
equivalent, but these are not Markov equivalent to H^. 




Figure 3: (a) A maximal ancestral graph H\. (b) A maximal ancestral graph H2 that is Markov equivalent to 
H\. (c) A maximal ancestral graph i/3 that is not Markov equivalent to H\ or H2. 



Second result for Markov equivalen ce for MAG s . In order to present the second the- 
orem, we quote two definitions from IZhao et al\ ( l2004j ). A path vr is called a collider 
path if all its inner nodes are colliders on vr. A collider path vr = {i,B,j) is called a 
minimal collider path if z 7^ j and there is no proper subset B' C B such that {i, B',j) 
is a collider path between i and j. If i ~ j then we call vr a minimal collider cycle. In 
the graph in Fig. Hlthe path {i,j, k, h) is a collider path, but it is not minimal collider 
since there exists the collider path (i, j, /i), which is minimal collider. 




Figure 4: A non-minimal collider path k, h) and a minimal collider path h). 
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Theorem 2. (iZhao et al.l . \2OO4) MAGs Hi and H2 are Markov equivalent if and only 
if Hi and H2 have the same skeleton and minimal collider paths. 

For the graphs in Fig. [3l by Theorem [2] we can make the same conclusion as before. 
To observe this it is enough to check that (i, j, k) and (i, j, fc, h) are the minimal collider 
paths of Hi and H2, whereas there is no minimal collider path in H^. We, therefore, 
conclude that Hi and H2 are Markov equivalent, but these are not Markov equivalent 
to H^. 



5.2 Internal Markov equivalence for subclasses of maximal ancestral graphs 



Markov equivalence for DAGs. 

Markov equivalence for DAGs. 



First of all we recall a well-known result regarding 



Proposition 1. ^Verma & Pearl . \l99(\ : \Frydenhera . \l99(\) DAGs Gi andG2 are Markov 
equivalent if and only if they have the same skeleton and unshielded collision V- configurations. 

In the example in Fig. [5] all three graphs have the same skeleton. In Gi there are 
two unshielded collision V-configurations {k,i, h) and (j, 2, h). In G2 there are the same 
unshielded collision V-configurations. Therefore, these two graphs are Markov equiva- 
lent. The only unshielded collision V- configuration in G3 is, however, {k,i,h). Hence 
this graph is not Markov equivalent to Gi and 6*2- 



(a) 



(b) 



(c) 



Figure 5: (a) A directed acyclic graph Gi. (b) A Markov equivalent directed acyclic graph G2 to Gi. (c) A 
directed acyclic graph G3 that is not Markov equivalent to Gi. 



Markov equivalence for UGs and BGs. The following proposition shows when two 
bidirected or undirected graphs are Markov equivalent. 

Proposition 2. Bidirected or undirected graphs Hi and H2 are Markov equivalent if and 
only if they are equal. 

Proof. In the case of the undirected graph, the result follows from Theorem [T] and the 
fact that there is no collider in undirected graphs. 

In the case of the bidirected graph, the result follows from Theorem [2] and the fact 
that every path in bidirected graphs is a collider path. □ 
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Markov equivalence for RCGs. Since RCGs are a subclass of MAGs, we simplify the 
conditions for Markov equivalence for MAGs in order to obtain the conditions for Markov 
equivalence for RCGs. 



Proposition 3. (iWermuth & Sadeahi . \20lA) RCGs Hi and H2 are Markov equivalent if 
and only if Hi and H2 have the same skeleton and unshielded collider V- configurations. 

Proof. We apply Theorem [1] to RCGs and simplify its conditions in order to obtain the 
conditions of this theorem. The first condition of Theorem [1] (having the same skeleton) 
is the same as the first condition of this theorem. Therefore, it is enough to prove that Hi 
and H2 have the same colliders with order if and only if they have the same unshielded 
collider V-configurations. 

An unshielded collider V-configuration is by definition a collider with order. We 
prove that in RCGs a collider V-configuration that is a collider with order is unshielded. 
This proves the proposition: Suppose that {h, k, I) is a collider with order and, for 
contradiction, is not unshielded. By the definition of collider with order there exists 
a discriminating path {x,qi, . . . ,qp = h,k,l) for k. Hence h G sp(A;). In addition, 
if / G pa(A;) then h G an(/c), a contradiction by the definition of RCGs. Therefore, 
/ G sp(/c), but again this is a contradiction since in RCGs for a collider V-configuration 
with two adjacent arcs {h,k,l), one endpoint (h) cannot be the parent of the other 
endpoint (/). □ 

In the example in Fig. [6] all three RCGs have the same skeleton. In Hi there are 
three unshielded collider V-configurations {l,h,k), {l,j,i), and {k,i,j). In H2 there are 
the same unshielded collider V-configurations. Therefore, these two graphs are Markov 
equivalent. The unshielded collider V-configurations in H^ are, however, {I, h, k) and 
{k,i,j). Hence this graph is not Markov equivalent to Hi or H2. 




(b) 



ik if 

(c) 



Figure 6: (a) A regression cliain grapli H\. (b) A Markov equivalent regression ciiain grapii II2 to H\. (c) An 
RCG (DAG) H-i tliat is not Markov equivalent to H\. 



5.3 External Markov equivalence for subclasses of mEiximal ancestral graphs 

As a corollary of Proposition |3l in order to check the external Markov equivalence for 
every two introduced subclasses of MAGs (excluding MAGs), i.e. RCGs, BGs, UGs, 
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and DAGs, the conditions that are used for Markov equivalence for RCGs can be used. 
In some cases, if we suppose that the graphs satisfy the conditions for representational 
Markov equivalence, which will be introduced in the next section, then the conditions 
for external Markov equivalence can be simplified. 

Corollary 1. Every two of RCG, BG, UG, and DAG are Markov equivalent if and only 
if they have the same skeleton and unshielded collider V- configurations. 

Proof. The result follows from the fact that BGs, UGs, and DAGs are subclasses of 
RCGs. □ 

Notice that for Markov equivalence for a UG and a graph H of another type the 
corollary states that there should be no collider V-configurations in H. 

6 Representational Markov equivalence and algorithms 

Structure of the section. In this section, in each subsection, we deal with represen- 
tational Markov equivalence for MAGs and its subclasses to a specific subclass. In each 
subsection we first introduce an algorithm for generating a graph of a specific subclass 
which is Markov equivalent to a given MAG. The algorithm is usually trivially simplified 
for subclasses of MAGs. We then introduce conditions for a MAG under which it is 
Markov equivalent to a graph from the given subclass. By simplifying these conditions 
we obtain the conditions for subclasses of MAGs under which they are Markov equivalent 
to a graph of the given subclass. Notice that representational Markov equivalence to the 
class of MAGs produces trivial results. 

6.1 Representational Markov equivalence to directed acyclic graphs 

Generating a DAG which is Markov equivalent to a given MAG. We begin with an 
algorithm for generating a Markov equivalent DAG to a given MAG that satisfies the 
conditions of Lemma [H 

Algorithm 1. (Generating a Markov equivalent DAG to a maximal ancestral graph H) 
Start from H . 

1. Apply the maximum cardinality search algorithm on H[ — ] to order the nodes. 

2. Orient the edges of H[ — ] from a lower number to a higher one. 

3. Replace unshielded collider V-configurations by unshielded collision V-configurations, 
i.e. replace i < > o < > j and i < > o — j by i — K o — j when i r/^ j . 

4. Order the nodes of the subgraph induced by arrows such that arrows are from higher 
numbers to lower ones. 



11 



5. Order the nodes of the subgraph induced by arcs arbitrarily by numbers not used in 
the previous step if the number for the node does not already exist. 

6. Replace arcs by arrows from higher numbers to lower ones. 

Continually apply each step until it is not possible to apply the given step further before 
moving to the next step. 

Lemma 1. Let H be a maximal ancestral graph. If H[ — ] is chordal and there is no 
minimal collider path or cycle of length A in H then Algorithm U\ generates a Markov 
equivalent DAG to H. 

Proof. Denote the generated graph by G. Graph G is directed since by Algorithm [H all 
edges are turned into arrows. Since H[ — ] is chordal, the graph generated by the perfect 
elimination order of t he maximal card i nality search does not have a direction-preserving 



In addition, the arrows present in the graph do not change by the algorithm. We 
show that there is no direction-preserving cycle after applying step 3: If, for contradic- 
tion, there is a shortest direction-preserving cycle after applying step 3 then a collider 
V-configuration {j,k,i) (say the jTc-edge is an arc) should turn into a transition V- 
configuration after applying step 3. In this case there is an hj-edge for a node h with an 
arrowhead pointing to j and h ^ k. Since there is no minimal collider path or cycle of 
length 4, (j, fc, i) is shielded. Notice that on the ji-edge there is an arrowhead pointing 
to j since otherwise there is a minimal collider path or cycle of length 4. This implies 
that the ji-edge is an arc, since otherwise a shorter direction-preserving path via the 
arrow from i to j is generated. 

Since this edge should turn into an arrow from j to i, i ^ h and there is a node I 
pointing to i such that / 7^ j. Since {h,j, i, I) and {k,j, i, I) are collider paths (or cycles), 
on the hi-edge there is an arrowhead pointing to i, and ki is an arc. To turn the ki-aic 
into an arrow from i to k there is a kp-edge with its arrowhead pointing to k, and p ^ i. 
Therefore, {p,k,i,h) is a minimal collider path (or cycle), a contradiction. Therefore, 
there is no direction-preserving cycle after applying step 3. 

Therefore, the ordering of step 4 is permissible, and by step 6 there are obviously no 
direction-preserving cycles generated. Therefore, G is acyclic. 

Now we prove that G is Markov equivalent to H: Since there is no minimal collider 
path of length 4 in if, by Theorem O H is Markov equivalent to G if and only if they have 
the same skeleton and unshielded collider V-configurations. Graph G obviously has the 
same skeleton as that of H. In addition, an unshielded collider V-configuration in G is 
an unshielded collider V-configuration in H . If, for contradiction, an unshielded collider 
V-configuration (i, k^j) in H does not exist in G then one of the arrowheads pointing to 
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k, say on edge ik, must be removed by step 3. Therefore, there is an unshielded colhder 
V-configuration {l,i,k) in H. Now {l,i,k,j) is a minimal collider path since / 7^ k and 
i ^ a. contradiction. □ 



It is easy to see that, for UGs, BGs, and RCGs that can be Markov equivalent to 
DAGs, the algorithm generates a Markov equivalent DAG to a given RCG, steps 1 and 
2 of the algorithm generate a Markov equivalent DAG to a given UG, and steps 3-6 of 
the algorithm generate a Markov equivalent DAG to a given BG. 

Fig. [7] illustrates how to apply Algorithm [1] step by step to a MAG. 




mo mo 



(e) (f) 

Figure 7: (a) A MAG. (b) The generated graph after applying step 1 of Algorithm [T] (c) The generated graph 
after applying step 2. (d) The generated graph after applying step 3. (e) The generated graph after applying 
step 4. (f) The generated DAG after applying step 6. 

Conditions for representational Markov equivalence for the class of MAGs and its sub- 
classes to DAGs. The following proposition shows that sufficient conditions for a given 
MAG, presented in Lemma [H are also necessary. The corollaries of this proposition 
illustrate the conditions under which RCGs, BGs, and UGs can be Markov equivalent 
to a DAG. 

Theorem 3. A maximal ancestral graph H is Markov equivalent to a DAG if and only 
if H[ — ] is chordal and there is no minimal collider path or cycle of length 4 in H. 
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Proof. (^) Suppose that the maximal ancestral graph H is Markov equivalent to a 
directed acyclic graph G. By Theorem [2] G must have the same skeleton and minimal 
collider paths as those of H. Since there is no collider V- configuration in H[ — ], the 
corresponding induced subgraph of G should have no unshielded collision nodes. If, for 
contradiction, this subgraph contains an induced n > 4, then there exists a collision 
V- configuration on the cycle, otherwise there exists a direction-preserving cycle in G, 
which is not permissible. This collision V-configuration is unshielded since n > 4 and 
Cn is chordless. This is a contradiction since G and H have the same skeleton. If H 
contains a minimal collider path or cycle tt then edges of tt cannot be oriented in G to 
generate a collider path. 

(<^=) The result follows from Lemma [TJ □ 

We recall the following known statement for BGs as a corollary to the proposition. 



Corollary 2. /(Pearl & Wermutn . \l99ji) A BG is Markov equivalent to a DAG if and 



only if it does not contain any P4 or C4 as induced subgraphs. 

Proof. For BGs, every path is a collider path, and every minimal collider path or cycle 
is a P4 or C4. Using these, the result follows. □ 

We also recall the following known statement for UGs as a corollary to the proposition; 



see 



LauritzenI ( 1l996l ). 



Corollary 3. A UG is Markov equivalent to a DAG if and only if it is chordal. 

Proof. For UGs, H[ — ] = H, and there is no collider path in UGs. Using these, the 
result follows. □ 

The following corollary shows the conditions under which RCGs can be Markov equiv- 
alent to DAGs. 

Corollary 4. An RCG with chain component node sets Ti, . . . ,tt is Markov equivalent 
to a DAG if and only if, H[ — ] is chordal and for 1 < i < T , the induced subgraph by 
Ti U pa(rj) does not contain any collider P4 or G4 as an induced subgraph. 

Proof. For RCGs, every collider path is in one of Tj U pa(rj), 1 < i < T. In addition, in 
RCGs a minimal collider path or cycle is chordless. Using these, the result follows. □ 



Necessary conditions for representational Markov equivalence to DAGs. Here we in- 
troduce some necessary conditions for Markov equivalence for MAGs, BGs, and RCGs 
to a DAG. For this purpose we use the following well-known graph theoretical result: 

Lemma 2. If a graph G contains no P4 or G4 as an induced subgraph then there is a 
node that is adjacent to all other nodes. 
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Corollary 5. Let H be a MAG and H[^r^] = (V,E). If H is Markov equivalent to a 
DAG then there exists a node that is adjacent to all other nodes in V U pa(V). 

Proof. Graphs with no minimal collider paths or cycles of length 4 do not contain a 
collider P4 or C4. In addition, every collider path in MAGs is in VUpa.{V). Using these, 
the result follows from Theorem E] and Lemma [2J □ 

Corollary 6. // a bidirected graph is Markov equivalent to a DAG then there exists a 
node that is adjacent to all other nodes. 

Proof. The result follows from Corollary [2] and Lemma [2j □ 

Corollary 7. // an RGG is Markov equivalent to a DAG then in each Ti U pa(rj), 1 < 
i < T, there exists a node that is adjacent to all other nodes in Ti U pa(rj). 

Proof. The result follows from Corollary H] and Lemma [2j □ 

6.2 Representational Markov equivalence to undirected and bidirected graphs 

Generating a UG which is Markov equivalent to a given MAG. By removing all arrow- 
heads one generates a Markov equivalent UG to a given MAG that satisfies the condition 
of Lemma [31 

Lemma 3. For a maximal ancestral graph H with no unshielded collider V- configuration, 
removing arrowheads generates a Markov equivalent UG to H . 

Proof. The generated graph is obviously a UG and is also the only UG that has the same 
skeleton as that of H. Neither H nor the generated graph contains any minimal collider 
paths. This completes the proof. □ 

One can therefore observe that, for DAGs, BGs, and RCGs that can be Markov 
equivalent to UGs, removing arrowheads generates a Markov equivalent UG to the given 
graph. 

Conditions for representational Markov equivalence for MAGs and its subclasses to 
UGs. The following proposition shows that the sufficient condition for a given MAG, 
presented in Lemma [3], is also necessary. The corollaries of this proposition illustrate the 
conditions under which BGs and DAGs can be Markov equivalent to a UG. 

Proposition 4. A maximal ancestral graph H is Markov equivalent to a UG if and only 
if there is no unshielded collider V- configuration in H. 
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Proof. (^) Suppose that H is Markov equivalent to an undirected graph G. Graphs 
H and G have the same skeleton and minimal collider paths, but G has no minimal 
collider paths. Since an unshielded collider V-configuration is a minimal collider path, 
H contains no unshielded collider V-configurations. 

{•^) The result follows from Lemma [31 □ 

One can also use this result for RCGs. Here we simplify the condition further for 
DAGs and BGs. 

Corollary 8. A directed acyclic graph G is Markov equivalent to a UG if and only if 
there is no unshielded collision V-configuration in H. 

Proof. The result follows from the fact that the only type of colliders in DAGs is collisions. 

□ 

Corollary 9. A BG is Markov equivalent to a UG if and only if it is complete. 

Proof. The result follows from the fact that all unshielded V-configurations in BGs are 
collider. □ 

Generating a BG which is Markov equivalent to a given MAG. Replacing all edges 
by arcs generates a Markov equivalent BG to a given MAG that satisfies the condition 
of Lemma HI 

Lemma 4. For a maximal ancestral graph H with no unshielded non- collider V-configuration, 
replacing all edges by arcs generates a Markov equivalent BG to H . 

Proof. The generated graph is obviously a BG and is also the only BG that has the 
same skeleton as that of H . All V-configurations in both H and the generated graph are 
colliders. This completes the proof. □ 

One can therefore observe that, for DAGs, UGs, and RCGs that can be Markov 
equivalent to BGs, replacing all edges by arcs generates a Markov equivalent BG to the 
given graph. 

Conditions for representational Markov equivalence for MAGs and its subclasses to 
BGs. The following proposition shows that the sufficient condition for a given MAG, 
presented in Lemma HI is also necessary. 

Proposition 5. A maximal ancestral graph H is Markov equivalent to a BG if and only 
if there is no unshielded non-collider V-configuration in H . 
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Proof. (^) Suppose that H is Markov equivalent to a bidirected graph G. Graphs H 
and G have the same skeleton and minimal collider paths, but every minimal path in G 
is a minimal collider path. Since an unshielded non-collider V-configuration is a minimal 
but not a collider path, H contains no unshielded non-collider V-configurations. 

(<^=) The result follows from Lemma HI □ 

One can also use this result for RCGs. Here we simplify the condition further for 
DAGs and UGs. The re sults have been known in the literature for long time, e.g., see 



Pearl fc WermuthI fll994h . 



Corollary 10. A directed acyclic graph G is Markov equivalent to a BG if and only if 
there is no unshielded non- collision V-configuration in H . 

Proof. The result follows from the fact that the only type of colliders in DAGs is collisions. 

□ 

Corollary 11. A UG is Markov equivalent to a BG if and only if it is complete. 

Proof. The result follows from the fact that all unshielded V-configurations in UGs are 
non-collider. □ 

6.3 Representational Markov equivalence to regression chain graphs 

Generating an RCG which is Markov equivalent to a given MAG. We begin with an 
algorithm for generating a Markov equivalent RCG to a given MAG that satisfies the 
conditions of Lemma [51 

Algorithm 2. (Generating a Markov equivalent RGG to a MAG H) 
Start from H . 

1. For a non-collider V-configuration i < > j — on an arc- direction-preserving cycle, 
remove the arrowhead pointing to j on the ij-edge when there is no unshielded 
collider V-configuration of form {i,j,l). 

Gontinually apply this step until it is not possible to apply it further. 

Lemma 5. For a maximal ancestral graph H with no arc-direction-preserving cycle on 
which every non-collider V-configuration i < > j — ^k is such that there is an unshielded 
collider V-configuration of form {i,j, I) , Algorithm\^ generates a Markov equivalent RGG 
to H. 

Proof. Denote the generated graph by G. To show G is an RCG, it is enough to 
show that there is no arc-direction-preserving cycle in G. We know that the only arc- 
direction-preserving cycles in H are those on which there is a non-collider V-configuration 
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i < > j — such that there is no unshielded colhder V- configuration I). In this case 
step 3 of the algorithm generates a source V-configuration, and therefore, destroys the 
arc-direction-preserving cycle. 

We now prove that G is Markov equivalent to H: First, we prove that minimal collider 
paths in H remain unchanged in G. Suppose, for contradiction, that there is a minimal 
collider path vr of length n, n > 3, containing an zj-arc, and the arrowhead pointing to 
j is removed by step 3 of the algorithm because of a V-configuration i < > j — >-k on an 
arc-direction-preserving cycle. Denote the three consecutive nodes on n by I). Since 
there is an arrowhead pointing to j on the j7-edge, i I. Since vr is minimal collider, 
there exists another node on tt, say h adjacent to /, i is an endpoint of tt, and the /i-edge 
is an arrow from I to i. 

Now there is an arc-direction-preserving cycle {i, j, I) on which the only non-collider V- 
configuration j < > I — r-i is such that there is a collider V-configuration (j, /, h). There- 
fore, this collider V-configuration should be shielded, i.e. h j. This edge is an arrow 
from j to h because vr is minimal collider. Therefore, {i,j,l,h) is a primitive inducing 
path, and since H is maximal, i ^ h. This contradicts the fact that vr is a minimal 
collider path. Therefore, minimal collider paths in H do not change by the algorithm. 

In addition, a non-minimal collider path in H cannot turn into a minimal collider 
path in G, since we know that in RCGs all collider paths are chordless. This completes 
the proof. □ 

Fig. [8] illustrates how to apply Algorithm [2] to a MAG. 



Conditions for representational Markov equivalence for MAGs and its subclasses to 
RCGs. Since UGs, BGs, and DAGs are subclasses of RCGs, there are no conditions 
needed under which they are able to be Markov equivalent to an RCG. The follow- 
ing proposition shows when a given MAG can be Markov equivalent to an RCG. The 
corollary of this proposition shows when UGs can be Markov equivalent to an RCG. 

Theorem 4. A maximal ancestral graph H is Markov equivalent to an RCG if and only 
if there is no arc-direction-preserving cycle on which every non-collider V-configuration 
i < > j — yk is such that there is an unshielded collider V-configuration of form {i,j,l). 




(a) 



(b) 



Figure 8: (a) A MAG. (b) The generated RCG after applying Algorithm [g] 
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Proof. (^) Suppose that H is Markov equivalent to a multivariate regression chain graph 
G. Suppose, for contradiction, that there is an arc-direction-preserving cycle vr' on which 
every non-collider V-configuration i^-^j — is such that there is an unshielded collider 
V- configuration If tt' has a chord qr then there are two shorter cycles including 

the chord and nodes on tt' that are on one side of q and r. One can observe that at least 
one of the two cycles has the same property as the property of tt' depending on whether 
there is an arrowhead pointing to g or r on zj-path. Hence, consider the minimal cycle 
TT in this sense, which is chordless. 

On vr all collider V-configurations are unshielded. In addition, all collider V-configurations 
of form are also unshielded. Therefore, since H is Markov equivalent to G, in G 

all these collider V-configurations should be preserved. Hence, all arcs on vr remain arcs 
in G. Moreover, by replacing the arrows on tt by arcs or by changing their directions 
a new unshielded collider V-configuration is generated. Therefore, arrows on vr are also 
unchanged in G. Therefore, vr exists in G. Since we know that arc-direction-preserving 
cycles are not permissible in RCGs, this is a contradiction. 

(<^=) The result follows from Lemma O □ 

7 Summary 

Summary of internal and external Markov equivalence for MAGs and its subclasses. 

In Section 5, we showed that for internal and external Markov equivalences for subclasses 
of MAGs, excluding MAGs themselves, the conditions for Markov equivalences for DAGs 
can be generalised naturally by using colliders instead of collisions. In other words, two 
subclasses of MAGs are Markov equivalent if and only if they have the same skeleton 
and unshielded collider V-configurations. 

Summary of representational Markov equivalence for MAGs and its subclasses. The 
following table represents the summary of the conditions needed for representational 
Markov equivalence for MAGs and its subclasses. In addition, for each non-trivial case of 
table, we provided algorithms to generate a graph other types that is Markov equivalent 
to the graph of a given type. 

The conditions presented in the table are for the graphs of the type indicated on the 
left column, which are to be Markov equivalent to a graph of the type indicated on the 
first row. 



19 



Table 1 : Necessary and sufficient conditions on H a graph of a subclass of maximal ancestral graph on the left 
column to be able to be Markov equivalent to a graph of the subclass of maximal ancestral graph on the top 
row. 





RCG 


BG 


UG 


DAG 




No arc-dir-pr cycle with 






H[—] Chordal; 


MAG 


every i < > j — >~k s.t. 


No unshielded 


No unshielded 


no minimal collider 




there is an unshielded 


non-collider. 


collider 


path or cycle 




collider {i, j, I) 






of length 4 


RCG 




No unshielded 


No unshielded 


No collider P4 or 






non-collider 


collider 


C4 in Ti U pa(Ti) 


BG 






Complete 


No P4 or C4 


UG 




Complete 
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DAG 




No unshielded 
non-collision 


No unshielded 
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